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Abstract 

We consider the problem of rate and power allocation for a sensor network under the pairwise 

distributed source coding constraint. For noiseless source-terminal channels, we show that the minimum 

^^ ' sum rate assignment can be found by finding a minimum weight arborescence in an appropriately defined 

^D ■ directed graph. For orthogonal noisy source-terminal channels, the minimum sum power allocation can 

be found by finding a minimum weight matching forest in a mixed graph. Numerical results are presented 

5_j ' for both cases showing that our solutions always outperform previously proposed solutions. The gains 

are considerable when source correlations are high. 
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I. Introduction 

The availability of low-cost sensors has enabled the emergence of large-scale sensor networks 
in recent years. Sensor networks typically consist of sensors that have limited power and are 



mattery-operated. The data that is sensed 
J is usually correlated. Thus, for sensor 



moreover energy constrained since they are usually 
by sensor networks and communicated to a termina 
networks it is important to allocate resources such as rates and power by taking the correlation 
into account. The famous Slepian-Wolf theorem [1] shows that the distributed compression (or 
distributed source coding) of correlated sources can in fact be as efficient as joint compression. 
Coding techniques that approach the Slepian-Wolf bounds have been investigated [2] and their 
usage proposed in sensor networks [3]. Typically one wants to minimize metrics such as the 
total rate or total power expended by the sensors in such situations. A number of authors have 
considered problems of this flavor [4], [5], [6]. These papers assume the existence of Slepian- 
Wolf codes that work for a large number of sensors. 

In practice, the design of low-complexity Slepian-Wolf codes is well understood only for 
the case of two sources (denoted X and Y) and there have been constructions that are able 
to operate on the boundary of the Slepian-Wolf region. In particular, the design of codes 
(eg. [7], [8], [9]) is easiest for the comer points (asymmetric Slepian-Wolf coding) where the 
rate pair is either {H{X), H{Y\X)) or {H{X\Y), H{Y)). Several symmetric code designs are 
proposed in [10], [11], [12] in which the authors mainly focus on two correlated sources. In 
[7], the correlation between two binary sources are assumed to be symmetric and the LDPC 
code is designed for a virtual BSC correlation channel, while the codes designed in [9], [10] 
and [11] are suitable for arbitrary correlation between the two binary sources. The authors of 
[13] proposed code designs for multiple sources. For two uniformly distributed binary sources 
whose correlation can be modeled as a BSC channel, their design supports both symmetric and 
asymmetric coding and approaches Slepian-Wolf bound. However, when it comes to more than 

'We shall use terminal and sink interchangably throughout this paper. 



two sources, in order to achieve optimum rate (joint entropy), they have a strong assumption 
on correlation model, i.e., the correlation between all the sources is solely described by their 
modulo-2 sum. Thus, given the current state of the art in code design it is of interest to consider 
coding strategies for sensor networks where pairs of nodes can be decoded at a time instead 
of all at once. This observation was made in the work of Roumy and Gesbert in [14]. In that 
work they formulated the pairwise distributed source coding problem and presented algorithms 
for rate and power allocation under different scenarios. In particular, they considered the case 
when there exist direct channels between each source node and the terminal. Furthermore, the 
terminal can only decode the sources pairwise. We briefly review their work below. The work 
of [14] considers two cases, 
i) Case 1 - Noiseless node-terminal channels. 

Under this scenario, they considered the problem of deciding which particular nodes should 
be decoded together at the terminal and their corresponding rate allocations so that the total 
sum rate is minimized, 
ii) Case 2 - Orthogonal noisy node-terminal channels. 

In this case the channels were assumed to be noisy and orthogonal and the objective was 
to decide which nodes would be paired so that overall power consumption is minimized. 
In [14], the problem was mapped onto the problem of choosing the minimum weight matching 
[15] of an appropriately defined weighted undirected graph. Each node participate in joint 
decoding only once. 

In this paper we consider a class of pairwise distributed source coding solutions that is larger 
than the ones considered in [14]. The basic idea is that previously decoded data can be used as 
side information for other sources. A simple example demonstrates that it is not necessary to 
only consider matchings Consider four correlated sources Xi,X2,X3 and X4. The solution of 
[14] constructs a complete graph on the four nodes Xi, . . . .X^ and assigns the edge weights 
as the joint entropies i.e. the edge (Xj,Xj) is assigned weight H(Xi,Xj). A minimum weight 
matching algorithm is then run on this graph to find the minimum sum rate and the rate allocation. 



Suppose that this yields the matching (Xi,X3) and (X2,X4) so that the sum rate becomes 
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1=1 
Since conditioning reduces entropy, it is simple to observe that 

H{X,, Xs) + H{X2, X4) > H{Xi) + H{Xs\X,) + H{X2\Xs) + H{X,\X2). 

We now show that an alternative rate allocation: Ri = H{Xi), R2 = if (X2IX3), i?3 = H{X3\Xi) 
and R4 = H{X4\X2) can still allow pairwise decoding of the sources at the terminal. Note that 
at the decoder we have, 

a) Xi is known since -Ri = H{Xi). 

b) X3 can be recovered by jointly decoding for X3 and Xi since Xi is known and the decoder 
has access to H{X'i\Xi) amount of data. 

c) X2 can be recovered since X3 is known (from above) and the decoder has access to 
H[X2\X^) amount of data. 

d) Similarly, X4 can be recovered. 

As we see above, the sources can be decoded at the terminal in a pipelined manner. Note that 
we can leverage the coding solutions proposed for two sources at the corner points in this case 
since the encoder for X3 can be designed assuming that Xi is known perfectly, the encoder for 
X2 can be designed assuming that X3 is known perfectly etc. The method of source-splitting 
[16], [17] is closely related to this approach. Given M sources and an arbitrary rate point in 
their Slepian-Wolf region, it converts the problem into a rate allocation at a Slepian-Wolf comer 
point for appropriately defined 2M — 1 sources. However as pointed out before, code designs 
even for corner points are not that well understood for more than two sources. Thus, while 
using source-splitting can result in sum-rate optimality i.e. the sum rate is the joint entropy, it 
may not be very practical given the current state of the art. Moreover, for M sources it requires 
the design of approximately twice as many encoders and more decoding sub-modules that also 
comes at the cost of complexity. 



In this paper, motivated by complexity issues, we present an alternate formulation of the 
pairwise distributed source coding problem that is more general than [14]. We demonstrate that 
for noiseless channels the minimum sum rate allocation problem becomes one of finding a 
minimum weight arborescence of an appropriately defined directed graph. Next, we show that 
in the case of noisy channels, the minimum sum power allocation problem can be mapped 
onto finding the minimum weight matching forest of an appropriately defined mixed graphu- 
Simulation results show that our solutions are significantly better than those in [14] in the cases 
when correlations are high. 

This paper is organized as follows. We formulate the problem and briefly review previous 
solutions based on matching in Section |Ill In Section UlI] and |IV] we present our solution for 
noiseless channels and noisy channels respectively. Numerical results for the both cases are given 
in Section |V] and Section |Vl] concludes this paper. 

II. Problem formulation and overview of related work 

Consider a set of correlated sources Xi, X2, . . . , X„ transmitting data to one sink in a wireless 
sensor network. We assume that every source can transmit data directly to the terminal. The 
source Xi compresses its data at rate Ri and sends it to the sink. We assume that the sources 
encode only their own data. Furthermore, we consider the class of solutions where the sink can 
recover a given source with the help of at most one other source. The problem has two cases. 
i) Case 1 - Noiseless node-terminal channels. 

Assume that there is no noise in the channel. In order to reduce the storage requirement at 
the sensors, we want to minimize the sum rate, i.e., min^"^j^ i?j. 
ii) Case 2 - Orthogonal noisy node-terminal channels. 

Assume that channels between sources and sink are corrupted by additive white Gaussian 
noise and there is no internode interference. In this case, source channel separation holds 
[18]. The capacity of the channel between node i and the sink with transmission power Pi 

^A mixed graph has both directed and undirected edges 



and channel gain 7^ is Ci{Pi) = log(l + 7jPj), where noise power is normalized to one and 
channel gains are constants known to the terminal. Rate Ri should satisfy Ri < Ci{Pi). Let 
[n] denote the index set {1, . . . , n}. The transmission power is constrained by peak power 
constraint: Vi G [n], Ri < Rmax- In this context, our objective is to minimize the sum power 
, i.e., min^"^^Pj. Note that in the implementation from the practical point of view, we 
can use joint distributed source coding and channel coding [19], [20], once the pairing of 
nodes involved in jointly decoding are known from the resource allocation solution. 
We now overview the work of [14]. For noiseless case, in order for the terminal to recover 
data perfectly, the rates for a pair of nodes i and j should be in the Slepian and Wolf region 

SWij = {{Ri, Rj) : Ri > H{Xi\Xj), Rj > H{Xj\Xi), Ri + Rj > H{Xi, Xj)} . 

Note that H{Xi, Xj) is the minimum sum rate while i and j are paired to perform joint decoding. 
The matching solution of the problem is as follows. Construct an undirected complete graph 
G = (V, E) , where \V\ = n. Let WE{i,j) denote weight on undirected edge (^, j), WEihJ) = 
H{Xi,Xj). Then, find a minimum weight matching V of G. For (z,j) E V, the optimal rate 
allocation {Ri, Rj) can be any point on the slope of the SW region of nodes i and j since 
they give same sum rate for a pair. We can simply set {Ri, Rj) for {i,j) G P to be either 
{H{Xi),H{Xj\Xi)) or {H{Xj),H{Xi\Xj)), i.e., at the corner points of SW region. 

For noisy case, the rate region for a pair of nodes is the intersection of SW region and capacity 
region Gij-. Gij{Pi,Pj) = {{Ri,Rj) : Ri < Gi{Pi),Rj < Gj{Pj)}. It is easy to see that for a 
node i with rate Ri and power Pi, at the optimum R* = Gi{P*), i.e. the inequality Ri < Gi{Pi) 
constraint is met with equality. Thus, the power assignment is given by the inverse function of 
Gi which we denote by Qi{Ri), i.e., P* = Qi{R*) = (2^»* — l)/7i. This problem can also be 
solved by finding minimum matching on a undirected graph. However the weights in this case 
are the minimum sum power for each pair of nodes. The solution has two steps: 

1) Find optimal rate-power allocations for all possible node pairs: V(i, j) G [n]^ s.t. i < j: 

{RU£),RUj)) = 8.TgmmQ,{R,^{{)) + Q,{R,,{j)) (1) 



S.t.{R,j{{), R,j{j)) e SWi, n aj{P„^ax, Pmax) (2) 

The power allocations are given by i^*(z) = Qi{B*j{i)) and P*j{j) = Qj{R*j{j)). The 
rates Rij{i), Rij{j) are the rates for node i and node j when i and j are paired. Note that 
when i and another node k j^ j are considered as a pair, the rate for i may be different,i.e., 
Rij{i) ^ Rik{i)- 
2) Construct an undirected complete graph G = {V,E), where WE{i,j) = Pij{i) + Pij{j) 
for edge («, j), and find a minimum matching V in G. The power allocation for node pair 
(i, j) G P denoted by (Pj, P^) is {P*j{i), P*j{j)) and the corresponding rate allocation can 
be found. 
The solution for step (1) is given in [14] and denoted as (P*j(i),P*j(j),R*j(i),R*j(j)). This 
solution is the optimum rate-power allocation between a pair of nodes i and j under the peak 
power constraint and SW region constraint. Note that in this case, the rate assignments for i and 
j do not necessarily happen at the corner of the SW region. 

in. Noiseless case 

As shown by the example in Section HI the rate allocation given by matching may not be 
optimum and in fact there exist other schemes that have a lower rate while still working with 
the current coding solutions to the two source SW problem. We now present a formal definition 
of the pairwise decoding constraint. 

Definition 1: Pairwise property of rate assignment. Consider a set of discrete memoryless 
sources Xi, X2, . . . , X„ and the corresponding rate assignment R = (Pi, P2, . . . , P„). The rate 
assignment is said to satisfy the pairwise property if for each source Xi,i G [n], there exists an 
ordered sequence of sources (Xj^, Xjj, . . . , Xj^,) such that 

Ri, > H{Xi,), (3) 

P,^ > H{Xi^ |Xi^_ J, for 2<j<k, and (4) 

P, > H{X,\XJ. (5) 



Note that a rate assignment that satisfies the pairwise property allows the possibility that each 
source can be reconstructed at the decoder by solving a sequence of decoding operations at the 
SW comer points e.g. for decoding source Xi one can use X,^ (since Ri^ > H{XiJ), then 
decode Xi^ using the knowledge of Xj^ . Continuing in this manner finally Xj can be decoded. 
A rate assignment R shall be called pairwise valid (or valid in this section), if it satisfies the 
pairwise property. In this section, we focus on looking for a valid rate allocation that minimizes 
the sum rate. An equivalent definition can be given in graph-theoretic terms by constructing a 
graph called the pairwise property test graph corresponding to the rate assignment. 
Pairwise Property Test Graph Construction 

1) Inputs : the number of nodes n, H(Xi) for all i E [n], H{Xi\Xj) for all i,j E [n]'^ and 
the rate assignment R. 

2) Initialize a graph G = {V, A) with a total of 2n nodes i.e. \V\ = 2n. There are n regular 
nodes denoted 1,2, ... ,n and n starred nodes denoted 1*, 2*, . . . , n*. 

3) Let Wa{J — > i) denote the weight on directed edge (j -^ i). For each i E [n]: 

i) If Ri > H{Xi) then insert edge {i* -^ i) with Wa{i* -^ i) = H{Xi). 
ii) If Ri > H{Xi\Xj) then insert edge (j -^ i) with Wa{j ^ i) = H{Xi\Xj). 

4) Remove all nodes that do not participate in any edge. 

We denote the resulting graph for a given rate allocation by G(R) = (V, A). Note that if R 
is valid, the graph still contains at least one starred node. Next, based on G(R) we define a 
set of nodes that are called the parent nodes. Parent(R) = {i*\{i* ^ i) E A}, i.e., Parent(R) 
corresponds to the starred nodes for the set of sources for which the rate allocation is at least 
the entropy. Mathematically if i* E Parent(R), then Ri > H(Xi). We now demonstrate the 
equivalence between the pairwise property and the construction of the graph above. 

Lemma 1: Consider a set of discrete correlated sources Xi, . . . X„ and a corresponding rate 
assignment R = (_Ri, . . . , i?„). Construct G(R) based on the algorithm above. The rate assign- 
ment R satisfies the pairwise property if and only if for all regular nodes i E V there exists a 
starred node j* E Parent(R) such that there exists directed path from j* to i in G(R). 

8 



Proof: Suppose that G'(R) is such that for all regular nodes i E V, there exists a j* E Parent(R) 
so that there is a directed path from j* to i. We show that this implies the pairwise property for 
Xj. Let the path from j* to i be denoted j* ^ j ^ ai . . . ^ ak ^ i. We note that Rj > H{Xj) 
by construction. Similarly edge {ai -^ «;+i) exists in G'(R) only because Rai+i > -f^(-^a;+i l-^aj 
and likewise Ri > H (XilXa,^) . Thus for source i we have found the ordered sequence of sources 
{Xj,Xaj, ■ ■ ■ ,Xa^^) that Satisfy properties ([3]), © and ([5]) in definition [TJ 

Conversely, if R satisfies the pairwise property, then for each Xj, there exists an ordered 
sequence (X,^, . . . ,Xi^) that satisfies properties ([3]), dH) and © from definition [T] This implies 
that there exists a directed path from il to i in G'(R), since {il ^ ii) E A because Ri^ > H(XiJ 
and furthermore {ij^i -^ ij) E A because Ri > if (Xj |Xj J, for j = 2, . . . , fc. ■ 

We define another set of graphs that are useful for presenting the main result of this section. 

Definition 2: Specification o/Gi* (R). Suppose that we construct graph G'(R) as above and 
find Parent(R). For each i* E Parent(R) we construct Gj. (R) in the following manner: For each 
j* E Parent(R)\{i*} remove the edge (j* -^ j) and the node j* from G(R). 

For the next result we need to introduce the concept of an arborescence [15]. 

Definition 3: An arborescence (also called directed spanning tree) of a directed graph G = 
{V, A) rooted at vertex r E V is a subgraph T of G such that it is a spanning tree if the 
orientation of the edges is ignored and there is a path from r to all w G V" when the direction 
of edges is taken into account. 

Theorem 1: Consider a set of discrete correlated sources Xi, . . . , X„ and let the corresponding 
rate assignment R be pairwise valid. Let G(R) be constructed as above. There exists another 
valid rate assignment R that can be described by the edge weights of an arborescence of Gi* (R) 
rooted at i* where i* E Parent (R) such that R'j < Rj, for all j E [n]. 

Proof: We shall show that a new subgraph can be constructed from which R can be obtained. 
This shall be done by a series of graph-theoretic transformations. 

Pick an arbitrary starred node j* E Parent(R) and construct Gj*(R). We claim that in the 
current graph Gj. (R) there exists a path from the starred node j* to all regular nodes i E [n]. 



To see this note that since R is pairwise valid, for each regular node i there exists a path 
from some starred node to i in G'(R). If for some regular node i, the starred node is j*, the 
path is still in Gj*{lVj. Now consider a regular node ii and suppose there exists a directed 
path k* ^ k ^ f3i... ^ ii in G(R) where k* e Parent(R), k* ^ j*. Since k* G Parent(R), 
Rk > H{Xk) > H{Xk\Xi) Ml e [n]. This implies that edge (/ ^ k) is in Gj.(R),V/ G [n], 
in particular, (j —* k) ^ G^. (R). Therefore, in Gj*(R) there exists the path j* ^ j ^ k ^ 
/?!...—> ?i. This claim implies that there exists an arborescence rooted at j* in Gj*(R) [15]. 

Suppose we find such one such arborescence T,* of G'j.(R). In Tj* every node except j* has 
exactly one incoming edge (by the property of an arborescence [15]). Let inc{i) denote the node 
such that {inc{i) -^ i) E T,.. We define a new rate assignment R' as 

^i = WA{,inc{i) ->i) = H{Xi\Xinc{i)) (for i e [n] and i ^ j), and 
R', = WA{f^j) = HiX,). 

The existence of edge (j* -^ j) E G'(R) implies Rj = H(Xj) < Rj. Similarly, we have R- < Ri 
for i E [n]\{j}. And it is easy to see that R is a valid rate assignment. ■ 

Thus, the above theorem implies that valid rate assignments that are described on arborescences 
of the graphs Gi* (R) are the best from the point of view of minimizing the sum rate. Finally 
we have the following theorem that says that the valid rate assignment that minimizes the sum 
rate can be found by finding minimum weight arborescences of appropriately defined graphs. 
For the statement of the theorem we need to define the following graphs. 

a) The graph G*"* = (y*°*, yl*°*) is such that V"*°* consists of n regular nodes 1, . . . , n and n 
starred nodes 1*,. . . ,n*, |\/*°*| = 2n. The edge set A*"* consists of edges (z* -^ i),WA{i* -^ 
i) = H{Xi) for I E [n] and edges (z -^ j), Wa{i -^ j) = H{Xj\Xi) for all i,j E [n]\ 

b) For each i = 1, . . . ,n we define Gi* as the graph obtained from G*°* by deleting all edges 
of the form (j* -^ j) for j ^ i and all nodes in {1*, . . . , n*}\{i*}. 

Theorem 2: Consider a set of sources Xi, . . . , X^- Suppose that we are interested in finding 
a valid rate assignment R = (_Ri, . . . , -R„) for these sources so that the sum rate Yl^=i^i ^^ 
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minimum. Let R** denote the rate assignment specified by the minimum weight arborescence 
of Gi* . Then the optimal valid rate assignment can be found as 

n 

Ropt = arg min V" R- 

ie{i,...,n}^ ^ 

Proof. From Theorem [1] we have that any valid rate assignment R can be transformed into new 
rate assignment that can be described on an arborescence of Gj* (R) rooted at i* and suitable 
weight assignment. It is component-wise lower than R. This implies that if we are interested 
in a minimum sum rate solution, it suffices to focus our attention on solutions specified by all 
solutions that can be described by all possible arborescences of graphs of the form Gi* (R) over 
alH* = 1*, . . . , n* and all possible valid rate assignments R. 

Now consider the graph Gi* defined above. We note that all graphs of the form Gi* (R) where 
R is valid are subgraphs of Gi* . Therefore finding the minimum cost arborescence of Gi* will 
yield us the best rate assignment possible within the class of solutions specified by G^. (R). 
Next, we find the best solutions R** for all i E [n] and pick the solution with the minimum cost. 
This yields the optimal rate assignment. ■ 

IV. Noisy case 

In this section we consider the case when the sources are connected to the terminal by 
orthogonal noisy channels. In this case, the objective is to minimize the sum power. Therefore 
the optimum rate allocation within a pair of sources may not be at the comer points of SW 
region. We want some node pairs working at corner points while some others working on the 
slope of the SW region. Taking this into account, we generalize the concept of pairwise property. 

For a given rate assignment R, we say that Xi is initially decodable if Ri > H{Xi), or 
together with another source Xj, {Ri, Rj) G SWij. If Ri > H{Xi), it can be decoded by itself. 
If (Ri, Rj) E SWij, SW codes can be designed for Xi,Xj and they can be recovered by joint 
decoding. In addition, if we take advantage of previously decoded source data to help decode 
other sources as we did in the noiseless case, starting with an initially decodable source, more 
sources can potentially be recovered. 
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Definition 4: Generalized pairwise property of rate assignment. Consider a set of discrete 
memoryless sources Xi, . . . , X„ and the corresponding rate assignment R = (_Ri, . . . , i?„). The 
rate assignment is said to satisfy the generalized pairwise property if for each Xj, z G [n], Xj is 
initially decodable, or there exists an ordered sequence of sources (Xj^, Xjj, . . . , Xj^.) such that 

Xj^is initially decodable, (6) 

R,^ > H{X,^ |X,^_ J, for 2<j<k. (7) 

R, > H{X,\XJ (8) 

A rate assignment R shall be called generalized pairwise valid (or valid in this section), if 
it satisfies the generalized pairwise property and for every rate Ri E R, Qi{Ri) < Pmax- A 
valid rate assignment allows every source to be recovered at the sink. A power assignment 
P = (Pi, P2, . . . , Pn) shall be called valid, if the corresponding rate assignment is valid. 

We shall introduce generalized pairwise property test graph. The input and initialization are 
the same as pairwise property test graph construction. Then, for each z G [n\. 
i) If Ri > H{Xi) then insert directed edge (z* -^ i) with weight Wa^i* ^ i) = Qi{H{Xi)). 
ii) If Ri > H{Xi\Xj) then insert directed edge (j -^ i) with weight iyA(j ^ i) = Qi{H{Xi\Xj)). 
iii) If {Ri,Rj) G SWij, then insert undirected edge (z,j) with weight WE{i,j) = Qi{R*j{i)) + 
QjiR*^{j)) = P*j(2)+P*j{j). Note that as pointed out in SectionlE (i^* (^), P*^{j), R*^(t),R*^{j)) 
are the optimum rate-power allocation between node pair {i,j) given by [14]. 
Finally, remove all nodes that do not participate in any edge. We denote the resulting graph for 
a given rate allocation by Gm(R) = (V^, E, A), where E is undirected edge set and A is directed 
edge set. Denote the regular node set as Vr C V. 

Lemma 2: Consider a set of discrete correlated sources Xi, . . . X„ and a corresponding rate 
assignment R = (i?i, . . . , i?„). Suppose that we construct Gm(R) based on the algorithm above. 
The rate assignment R is generalized pairwise valid if and only if, V-Rj G Il,Qi{Ri) < Pmax, 
and for all regular nodes i G Vr, at least one of these conditions holds: 

1) i participates in an undirected edge (z, i), i' E Vr; 

2) There exists a starred node i* and an directed edge (z* -^ z); 
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3) There exists a starred node j* such that there is a directed path from j* to i; 

4) There exists a regular node j participating in edge {j,j ), j' E Vr such that there is a 
directed path from j to i; 

The proof of this lemma is very similar to that of Lemma [IJ If one of the conditions 1) and 2) 
holds, Xi is initially decodable, and vice versa. If one of the conditions 3) and 4) holds, Xj can 
be decoded in a sequence of decoding procedures which starts from an initially decodable source 
Xj, and vice versa. Next, we introduce some definitions crucial to the rest of the development. 

Definition 5: Given a mixed graph G = (V, E, A), if e = (i — > j) E A, i is the tail and j is 
the head of e. If e = {i,j) E E, we call both i and j the head of e. For a node i E V, hc{i) 
denotes the number of edges for which i is the head. 

Definition 6: The underlying undirected graph of a mixed graph G denoted by UUG{G) is 
the undirected graph obtained from the mixed graph by forgetting the orientations of the directed 
edges, i.e., treating directed edges as undirected edges. 

As pointed out previously, we want some nodes to work at corner points of two-dimensional 
SW region and others to work on the slope. Thus, we need to somehow combine the two 
concepts of arborescence and matching. The appropriate concept for our purpose is the notion 
of a matching forest first introduced in the work of Giles [21]. 

Definition 7: Given a mixed graph G = {V,E,A), a subgraph F of G is called a matching 
forest [21] if F contains no cycles in UUG{F) and any node i E V is the head of at most one 
edge in F, i.e. Vz E V, hpii) < 1. 

In the context of this section we also define a strict matching forest. For a mixed graph G 
containing regular nodes and starred nodes, a matching forest F satisfying /if(0 = l?^^ ^ ^R 
(i.e. every regular node is the head of exactly one edge) is called a strict matching forest(SMF). 
In the noisy case, the SMF plays a role similar to the arborescence in the noiseless case. Now, 
we introduce a theorem similar to Theorem \T\ 

Theorem 3: Given a generalized pairwise valid rate assignment R and corresponding power 
assignment P, let G'j\/(R) be constructed as above. There exists another valid rate assignment 
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R and power assignment P that can be described by the edge weights of a strict matching 
forest of Gm{R) such that ^!Li H < ELi Pi- 
Proof. In order to find such a SMF, we first change the weights of G'j\/(R), yielding a new 
graph G'j^jCR). Let W'^{i -^ j), W'^{i,j) denote weights in ^^/(R). Let A be a sufficiently large 
constant. We perform the following weight transformation on all edges. 

We{z,j) = 2A-We{z,j), W'A^^J)=A-WA{^-^J). (9) 

Denote the sum weight of a subgraph G' of graph G'j^jCR) as Wt^' ,-^JG'). Next, we find a 
maximum weight matching forest of Gj^j(lV). which can be done in polynomial time [22]. 

Lemma 3: The maximum weight matching forest Fm in (j^j(R) is a strict matching forest, 
i.e., it satisfies: Vi G Vr, hpjyjii) = 1- 

Proof. See Appendix. 

Note that each regular node is head of exact one edge in Fm- The power allocation is performed 
as follows. Any i E Vr is the head of one of three kinds of edges in Fm corresponding to three 
kinds of rate-power assignment: 

1) If 3{i* ^ i) e Fm, then set P- = Qi{H{Xi)) and R[ = H{Xi). The existence of edge 
{i* -^ i) in Ga/(R) means that Ri > H{Xi), so i?- < i?, and P- < Pi < Pmax- 

2) If 3{t,j) e Fm, set P- = P*^{i), R[ = R*^{{) and P- = i^*(j), R', = R*,U)- The existence 
of edge (?,j) in Gjv/(R) means that Ri and Rj are in the SW region. Pi < Pmax and 
Pj < Pmax- We know that P*j{i), P*j{j) is the minimum sum power solution for node i 
and j when the rate allocation is in SW region and the power allocation satisfies Pmax 

constraints. So P- + P^ < P, + Pj, P- < Pmax, Pj < Pmax- 

3) If 3(j ^i) e Fm, set P- = Qi{H{Xi\Xj)) and R'- = H{Xi\Xj) . The existence of edge 
(j -^ i) in Ga/(R) means that Ri > H{Xi\Xj), so i?- < Ri and P- < Pi < Pmax- 

Therefore, the new power allocation P reduces the sum power. Notice that when we are 
assigning new rates to the nodes, the conditions in Definition |4] still hold. So the new rate R' is 
also valid. So P' is a valid power allocation with less sum power. ■ 
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The following theorem says that the valid power assignment that minimizes the sum power 
can be found by finding minimum weight SMF of an appropriately defined graph. 

The graph G*"* = (y*°*, A*"*, £'*"*) is such that y*°* consists n regular nodes 1, . . . , n and n 
starred nodes 1*, . . . ,n*, and |\/*°*| = 2n. The directed edge set ^4*°* consists of edges (i* — > 
i),WA{i* ^ i) = Qi{H{Xi)) for {i : i e [n] and Qi{H{Xi)) < Pmax}, and directed edges 



U 



3),WA{t ^ j) = Qj{H{X^\X,)) for {z,j : z,j G M^ and Q,(iJ(X,|X,)) < P^,J. The 



undirected edge set E^°^ consists of edges {i,j), WE{i,j) = PiA"^) + PijiJ) for all «, j G [n]'^. 

Assume that Pmax is large enough so that there exist at least one valid rate-power allocation, 
the following theorem shows that the optimal rate-power allocation can be found in G*"*. 

Theorem 4: Consider a set of sources Xi, . . . , X„. Suppose that we are interested in finding 
a valid rate assignment R and its corresponding power assignment P for these sources so that 
the sum power J2^=i Pi — Yll=i Qi{Ri) is minimum. The optimal valid power assignment can 
be specified by the minimum weight SMF of G*"*. 

The proof of this theorem is similar to that of Theorem [21 Note that matching is a special 
case of matching forest, and is also a special case of SMF in our problem. Therefore, minimum 
weight SMF solution is always no worse than minimum matching solution. 

We now show that the minimum SMF in G*°* can be found by finding maximum matching 
forest in another mixed graph after weight transformation. We can perform the same weight 
transformation for G*°* as we did for Gm(R). Denote the resulting graph as G*°* . Find the 
maximum weight matching forest F^^ in G*°* . Denote the corresponding matching forest in 
Qtot ^g p^^_ -^g claim that both F^j and Fm are SMFs. To see this, note that since there exists 
valid rate allocation R, G'^j(R) is a subgraph of G*°*'. From Lemma |3l we know that SMF 
exists in Gj,j(R). Therefore, SMF also exists in G*°* . Because in a SMF starred node is not 
head of any edge and regular node is head of exact one edge, based on weight transformation 
rules, the weight of a SMF Fg in G*°*' is: 

Wt(.tot'{F's) =nA- WtGtot{Fs) (10) 

where Fs is the corresponding SMF in G*°*. Weight of any non-strict matching forest F^s 
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is Wt^tot'iF'j^g) = niA — H^t^tot (Ftvs) , m < n. Since A is sufficiently large, WtQtot'{F'g) > 
WtQtot'{Fj^g), i.e., SMFs in G*"* always have larger weights. Therefore, the maximum weight 
matching forest F'j^j in G*"*' is SMF. So is the corresponding matching forest Fm in G*"*. From 
(flOl) . it is easy to see in G*°* the matching forest corresponding to F^^ (the maximum weight 
matching forest in G*°* ) has minimum weight, i.e., Fm is the minimum SMF in G*°*. 

V. Numerical results 

We consider a wireless sensor network example in a square area where the coordinates of 
the sensors are randomly chosen and uniformly distributed in [0, 1]. The sources are assumed 
to be jointly Gaussian distributed such that each source has zero mean and unit variance (this 
model was also used in [23]). The off-diagonal elements of the covariance matrix K are given 
by Kij = exp{—cdij), where dij is the distance between node i and j, i.e., the nodes far 
from each other are less correlated. The parameter c indicates the spatial correlation in the 
data. A lower value of c indicates higher correlation. The individual entropy of each source is 
Hi = l log(27rea2) = 2.05. 

Consider the noiseless case first. Because the rate allocation only depends on entropies and 
conditional entropies, we do not need to care the location of the sink. It is easy to see based on 
our assumed model that H{Xi\Xj) = H{Xj\Xi),yi,j e [n]"^. Thus, WAii -^ j) = WaU -^ i). 
It can be shown that the weights of minimum weight arborescences Gi*,i = 1, . . . ,n are the 
same. Therefore, we only need to find minimum weight arborescence on Gi*. A solution for a 
sensor network containing 20 nodes are shown in Fig{TJ Since the starred node 1* is virtual in the 
network, we did not put it on the graph. Instead, we marked node 1 as root in the arborescence, 
whose transmission rate is its individual entropy Hi. Edge {i -^ j) in the arborescence implies 
that Xi will be decoded in advance and used as side information to help decode Xj. The matching 
solution for the same network is shown in Figl2l As noted in [14], the optimum matching tries 
to match close neighbors together because H{Xi, Xj) decreases with the intemode distance. Our 
arborescence solution also showed similar property, i.e., a node tended to help its close neighbor 
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since the conditional entropies between them are small. In FigjSl we plot the normalized sum 
rate Rgo = XlILi ^i/^i ^^- the number of sensors n. If there is no pairwise decoding, i.e., the 
nodes transmits data individually to the sink, Ri = Hi and RgQ = n. The matching solution 
and the minimum arborescence (MA) solution are compared in the figure. We also plotted 
the optimal normalized sum rate H(Xi, . . . ,Hn)/Hi in the figure. The rate can be achieved 
theoretically when all sources are jointly decoded together. We observe that if the nodes are 
highly correlated (c = 1), the present solution outperforms the matching solution considerably. 
Even if the correlation is not high, our MA solution is always better than matching solution. It 
is interesting to note that even though we are doing pairwise distributed source coding, our sum 
rate is quite close to the theoretical limit which is achieved by n-dimensional distributed source 
coding. 

Next, we consider optimizing the total power when there are AWGN channels between the 
sources and the sink. The channel gain 7^ is the reciprocal of the square of the distance between 
source Xi and the sink. We assume that the coordinates of the sink are (0, 0). An example of the 
strict matching forest (SMF) solution to a network with 16 sensors is given in FiglH There is 
one undirected edge in the SMF implying that the heads of this edge work on the slope of SW 
region. Other 14 edges are directed edges implying that the tails of the edges are used as side 
information to help decode their heads. No node is encoded at rate Hi. In fact, most minimum 
SMFs in our simulations exhibit this property, i.e., the minimum SMF contains 1 undirected edge 
and n — 2 directed edges between regular nodes. This fact coincides our intuition: transmitting at a 
rate of conditional entropy is the most economical way, while transmitting at a rate of individual 
entropy consumes most power. The matching solution for the same network is given in FigjS] We 
compare sum powers of the SMF solution with matching solution in TablelH The sum powers 
were averaged over three realizations of sensor networks. We also found the theoretical optimal 
sum power when n-dimensional distributed source coding is applied by solving the following 
convex optimization problem. 
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n n 

subject to (2^' - l)/7, < P„^ax,yi 
{R^,...,Rn)eSWr. 

where SWn is the n-dimensional Slepian-Wolf region. From the table, we can observe that our 
strategy always outperforms the matching strategy regardless of the level of correlation, and 
comes quite close to the theoretical limit that is achieved by n-dimensional SW coding. 

VI. Conclusion 

The optimal rate and power allocation for a sensor network under pairwise distributed source 
coding constraint was first introduced in [14]. We proposed a more general definition of pairwise 
distributed source coding and provided solutions for the rate and power allocation problem, which 
can reduce the cost (sum rate or sum power) further. For the case when the sources and the 
terminal are connected by noiseless channels, we found a rate allocation with the minimum 
sum rate given by the minimum weight arborescence on a well-defined directed graph. For 
noisy orthogonal source terminal channels, we found a rate-power allocation with minimum 
sum power given by the minimum weight strict matching forest on a well-defined mixed graph. 
All algorithms introduced have polynomial-time complexity. Numerical results show that our 
solution has significant gains over the solution in [14], especially when correlations are high. 

Future research directions would include extensions to resource allocation problems when 
joint decoding of three (or more) sources [24] at one time is considered, instead of only two 
in this paper. Another interesting issue is to consider intermediate relay nodes in the network, 
which are able to copy and forward data, or even encode data using network coding [25]. 
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Appendix 
PROOF OF LEMMA [3] 

We shall first introduce and prove a lemma which facilitates the proof of Lemma |3l 

Lemma 4: Consider two nodes i and j in a matching forest F such that either hpii) = or 
hpij) = 0, and they do not have incoming directed edges. Then, there does not exist a path of 
the form 

i-tti-tta ttfc-j (11) 

in UUG{F). 

Proof. First consider the case when hF{i) = hp{j) = 0, i.e., i,j only have outgoing directed 
edge(s). Suppose there is such a path (fTTI) . edge {i, ai) should directed from i to ai in F since 
hp(i) = 0, similarly, j -^ ak- As depicted in Figj6l at least one node ai in the path will have 
hp{ai) = 2. But we know that hpit) < 1 holds for every node t E V in matching forest F. So 
there is no such path (fTTI) in UUG{F). If hp(i) = 0, hp(j) = 1 and j connects to an undirected 
edge {j,j') in F, i,j and j' can only have outgoing directed edge(s). By similar arguments 
above, we know that at least one node ai on the path is such that hp{ai) = 2. Similarly, the 
case when i connects to an undirected edge and hp{j) = can be proved. ■ 

Proof of Lemma\3} We will prove this lemma by contradiction. We shall show that if hp^^{i) = 
for a regular node i, we can find another matching forest F in G^j(R) such that Wt^' ,^^ (F ) > 
Wt(j> (R)(-^A/), i.e., Fm is not the maximum matching forest. Since Fm is a matching forest, it 
satisfies (a) hpj^j{t) < 1 for every nodqj t eV and (b) no cycle exist in UUG{Fm)- Suppose 
hpj^jii) = for a regular node i in Fm- We shall make a set of modifications to Fm resulting 
in a new matching forest F' and prove that these manipulations will eventually increase the 
sum weight, make hpi{i) become 1 and ensure that there is no cycle in UUG{F ). Also, these 
modifications should guarantee that hp'{j) = 1 for j E {j : j E Vfj\{i} and hp^^{j) = 1}, i.e. 

^Actually, for a star node i* £ V\Vr, hpii*) = in all matching forest F of Gj(/(R) because there is no incoming edge 
to i* and i* does not participate in any undirected edge. 
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nodes that were previously the head of some edge continue to remain that way.During the proof, 

we shall use the properties of G^(R) given in Lemma [2l Since R is valid, regular node i has 

at least one of those four properties in G^j(R). We shall discuss these cases in a more detailed 

manner: 

Case 1. If there exists a directed edge (i* -^ i) in G,^[(R), add this edge to Fm to form F' . 

Clearly, Wt^i (R)(-^') ^ Wt^i (r)(-^a/)- Since there is only one outgoing edge from i* and it 

has no incoming edge, no cycle in UUG{F ) is produced in our procedure. And hpi{t) < 1 still 

holds for every node t G V, so F is still a matching forest. 

Case 2. If there exists an undirected edge (z, j) in G^j(R), we can include this edge to Fm to 

increase sum weight. Here, hpj^j{i) = and there are two possibilities for hp^^{j), or 1. 

Case 2a. If hF^i{i) = 0, add undirected edge (i,j) to Fm, resulting a new subgraph F' . 
Obviously, the sum weight is increased while adding one edge. Since hp^iii) = hp^iij) = 0, by 
Lemma m there does not exist path with form (fTTI) in UUG{Fm)- Thus, adding {i,j) does not 
introduce cycle in UUG{F'). F is a matching forest. 

Case 2b. If hpf^jij) = 1, we still add (z, j) but need to perform some preprocessing steps. Based 
on what kind of edge connects to node j, we have two cases: 

Case 2hi. If there exists one directed edge (j — > j) in Fm, delete edge (j ^ j), we have an 
intermediate matching forest F such that hF"{j) = 0. Add the undirected edge {i,j) to obtain 
F . Note that F is a matching forest because of arguments in Case 2a and Wt^i ,^. (F ) > 
Wt(j> (R)(-^A/) because for a sufficient large A, 2A - WE{i,j) > A - Wa{j' -^ j). 
Case 21)2. If there exists one undirected edge (j, j) in Fm, we notice that the existence of 
(j',j) in G'm^R) indicates that (i?/,i?j) G SW^'j, so R^' > H{X.>\Xj) and Rj > H{Xj\X.') 
, which implies that there exist directed edges (j -^ j ) and (j ^ j) in ^^^^(R). So we can 
first delete edge (j , j) and then add edges (z, j) and (j ^ j ) to form F . Adding (j ^ j ) is 
to make sure hp'{j') = 1. These modifications are shown in FigjT] After removing edge (f ,j), 
we have an intermediate matching forest F^ such that hpi(j) = and hpi(j ) = 0. We add 
edge {i,j) to obtain F^. Because of Lemma HI F^ is still a matching forest and hp2(j ) = 0. 
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Then we add (j ^ j ) to obtain a new subgraph F . From Lemma HI we know that (j -^ 
j ) will not introduce cycle. Therefore, F is still a matching forest. For a large enough A, 
(2A - WE{i,j)) + (A - Wa{J -^ j')) > 2A - WeUJ') holds, so the sum weight will increase. 
Case 3. If there exist a path from h to i in G^j(R):/i — > 71 — > 72 — ^ ■ ■ ■ ^ 7fci ^ ^, where h is 
a starred node or participates in an undirected edge in Gj^j(R), we use the following approach. 
Note that 71,..., 7^^ may participate in undirected edges. On this path, we find the node j 
closest to i such that j participates in an undirected edge in Gj^j{lVj or it is a starred node. 
j may be the same as h or be some 7^. We will focus on the path from j to i, denoted by 
j ^ ai ^ a2 ^ ■ ■ ■ ^ ak ^ i. The basic idea is to add edge ak ^ i into Fm- However, if 
we just simply add this edge, it may produce cycle in underlying undirected graph. So we need 
more manipulations. 
Case 3a. If j is a starred node, denote j as j*, we want to add the path 

f -^ ai -^ a2 -^ ^ ak -*i (12) 

to Fa/. First, in Fm, remove all incoming directed edges to a^ (1 < / < k), then we have 
an intermediate matching forest F^. Note that j*, i, and a^'s only have outgoing edges, by 
Lemma m we know that there does not exist undirected path with the form j*(or a^J — Pi — 
P2 — ■ ■ ■ — Pk — ^(or ai^) in UUG{F^) where /5's are nodes outside the path (fT2l) . Therefore, 
adding path (fT2l) into F^ to form F will not introduce a cycle. All nodes a;(l < / < A;) on 
the path, hp'{ai) = I. F is a matching forest. Next we shall consider the weights. At some 
nodes, take ai for example, although we deleted directed edge (a^ ^ ai), where a^' is a node 
outside path (fT2l) . we add another directed edge (a;_i -^ ai). The weight might decrease by 
(A — WA{ai' — ^ ai)) — (A — WA{ai-i — ^ ««))• Suppose we delete and add edges around d 
nodes:ai^,ai2, ..., ai^, the total weight decrease is X]f=i WAiai^-i -^ aij - WA{aiJ -^ aij. It 
may be positive but it does not contain a A term. At the end, we will add (ak —* i) without 
deleting any edge coming into i since hp^X^) = 0, the weight will increase (A — WA{ak -^ 0) 
by this operation. If A is large enough, the sum weight will finally increase. 
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Case 3b. If j participates in an undirected edge (j ,j) in Gj^j(R). Note that j 7^ ai, . . . ,afc 

since j is the first node in the path that participates in an undirected edge. In this case, if (j , j) 

is already in Fj\/, we just need to add the path (fT2l) from j to i as we did in the case above to 

form F . The resulting path is : j — j ^ ai — > ^2 ^ ■ ■ ■ — > «fc — > ^ Note that in Fm, j ,j do 

not have directed incoming edges. By similar argument in the previous case, we know that F 

is a matching forest. If (j ,j) is not in Fm, we want to add (j ,j) to F^ and then add the path 

(fT2l) . We have four possibilities, some of which require preprocessing: 

Case 3fei. hpj^jU) = and hpj^j{j ) = 0; we can add (j ,j) as we did in Case 2a, and then we 

add path (IT2l) as we did above. 

Case 362- hp^j{j) = and hp^j{i') = 1; we can add (/, j) after some preprocessing as we did 

in Case Ihi and Case 262, and then we add path (fT2l) as we did above. 

Next we discuss cases in which /^FmO) = 1- ^^ this case, we only need to consider some directed 

edge (j " — > j) comes into j in F^/. If there some undirected edge {j'\j) connecting j in Fm, 

this case has been discussed in Case 36 above, by treating j as j . 

Case 363. /ifm(j) = 1> (j" -^ j)' and /ifm(j') = 0; We can delete (j" ^ j) and add (j,j') 

as we did in Case 26i, node j is regarded as i in Case 26i, it is guaranteed that the resulting 

subgraph is a matching forest. And then we add path (fT2l) as we did above. 

Case 364. hp^j{j) = 1, (j" ^ j), and hF^.,{j') = 1; For j', it could be head of an undirected 

edge or a directed edge. If j' is head of an undirected edge {/ ,j"'), we perform operations 

shown in Figl8]to get F'. The possible weight decrease during our operations around node j is 

{WaW ^ /") - WAif -^ j)) + iiWEij,/) - WeU',/")). We will add edge (a^ -^ i) on path 

(fT2l) with weight A — WAi^k -^ i)- Since A is large enough, the sum weight will still increase. 

If j' is head of a directed edge (j" -^ j'), we perform operations shown in Figl9] to get F'. 

Similarly, because A is large enough, the sum weight will increase. 
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Arborescence solution under noiseless channel: Sum Rate = 21 .96 
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Fig. 1. Minimum arborescence solution in a WSN with 20 nodes. Noiseless channels are assumed. Correlation parameter 
c — 1. Sum rate given by MA equals to 21.96, which is less than sum rate given by matching. The theoretical optimal sum rate 
is 20.54. 
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Matching solution under noiseiess ciiannel: Sum Rate - 30.27 
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Fig. 2. Minimum matching solution in the same WSN as Fig[T] Noiseless channels are assumed. Correlation parameter c = 1. 
Sum rate given by matching equals to 30.27. Note that if we do not take advantage of correlation and transmit data individually, 
the sum rate will be 20 x Hi = 40.94. 
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Minimum strict matchiing forest soiution, Sum power = 16.27 
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Fig. 4. Minimum strict matcliing forest solution in a WSN witli 16 nodes. AWGN channels are assumed. Correlation parameter 
c = 1. Peak power constraint Pmax = 10. Sum power given by SMF equals to 16.27. The optimal sum power when we apply 
n-dimensional SW codes is 14.06. 
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Matching solution exampie fornoisy cliannei, Sum powers 27.12 
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Fig. 5. Minimum matching solution in the same WSN as Fig|4] AWGN channels are assumed. Correlation parameter c = 1. 
Peak power constraint Pmax = 10. Sum power given by matching equals to 27.12. Note that if we do not take advantage of 
correlation and transmit data individually, the sum power will be 47.11. 
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TABLE I 

Comparison of sum powers between minimum strict matching forest and matching solution. Pmax = 10. 



Number of nodes 


4 


8 


12 




SMF 


5.57 


7.49 


11.17 


c= 1 


Matching 


6.20 


10.71 


16.99 




Optimal 


5.45 


7.06 


9.93 




SMF 


6.22 


16.72 


21.15 


c = 3 


Matching 


6.30 


17.81 


23.79 




Optimal 


6.17 


16.44 


20.60 




SMF 


9.68 


18.65 


25.14 


c = 5 


Matching 


9.92 


18.91 


25.83 




Optimal 


9.67 


18.56 


24.96 
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Fig. 6. Case 2a: When hpj^i (i) = 0, hpj^i (j) ~ 0, path i — ai — 02 — ■ ■ ■ — j can not exists in UUG{Fm) because it will 
cause at lease one node ai, hF^i[ai) — 2. 
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Fig. 7. Case 2&2 When hp^i'^') = 0, hp^jij) — 1, (j, j ) G -Fj\f, by introducing two intermediate matching forest F^ , F^, we 
can find a new matching forest F with larger sum weight. 
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Fig. 8. Case 364-1: When /iF„(i) = /iFjv,(j ) = l,(i ,i) eG„(R),(j -> i) G Fa/, (j , j ) G Fm, remove (j ^ j) to 
form an intermediate matching forest F^ where hpi (j) = 0, hpi (j ) = 1, and (j ,j ) G F^. Then apply the same operations 
as case(262), resulting another matching forest F^. Finally add the path from j to i to get F . 
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Fig. 9. Case 3b4-2: when hp^jU) = /if^O' ) = 1, (j J) G GmC^), (j ^ j) G -F'a/, (j ~* j ) e Fm, remove (j -» j) 
to form an intermediate matching forest F^ where hpi{j) — 0,hpi{j ) = 1, and (j — » j ) G F^. Then apply the same 
operations as case(26i), resuUing another matching forest F^. Finally add the path from j to i to get F . 
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